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INTRODUCTION 


Three  essentials  to  combat  readiness  are  manpower,  materiel, 
and  equipment  manuals.  Equipment  manuals  provide  the  Information  and 
communication  link  between  the  soldier  and  the  equipment  he  must  oper- 
ate and  maintain.  These  manuals  also  contribute  directly  to  the  reli- 
ability, maintainability,  and  operational  effectiveness  of  the  Army's 
weapon  systems.  To  obtain  full  advantage  of  these  systems  we  must 
provide  the  soldier  with  accurate,  complete,  and  understandable  equip- 
ment manuals. 


\ 

This -pres«atati<MV*describes  a recently  developed  method  for 
evaluating  the  technical  adequacy,  accuracy,  and  readability  of  Army 
equipment  manuals.  The  method  is  entitled  the  Instructional  Material  -r 
Adequacy  Guide  and  Evaluation  Standard  (IMAGES) . The  "pteaeatetionP 
also  includes  a brief  summary  of  the  results  of  a 6-month  pilot  study 
of  IMAGES  at  four  of  the  Army's  proving  grounds. 


BACKGROUND 


In  January  1975  an  article  was  published  in  an  Army  Materiel 
Command  (AMC)  newsletter  regarding  the  large  number  of  complaints  from 
the  field  about  the  inadequacies  of  the  Army's  technical  manuals.  As 
many  as  350  complaints  were  received  during  one  3-month  period. 


As  the  developer's  tester  and  evaluator,  the  US  Army  Test 
and  Evaluation  Command  (TECOM)  is  responsible  for  verifying  and  evalu- 
ating the  technical  adequacy,  accuracy,  and  utility  of  draft  equipment 
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manuals  for  all  Army  equipment  and  weapon  systems  submitted  for 
development  test  and  evaluation. 

During  July-August  1975,  TECOM  conducted  an  investigation  of 
the  methods  employed  for  evaluating  manuals.  Based  on  interviews  and 
discussions  with  maintenance  personnel  at  each  proving  ground,  it  was 
found  that:  (1)  there  was  no  systematic  or  standard  method  for  evalu- 
ating technical  manuals,  (2)  the  techniques  employed  were  dependent 
upon  the  subjective  judgment  and  experience  of  the  particular  evalu- 
ator, and  (3)  there  was  no  consistent  measurement  standard  for  classi- 
fying defects  or  determining  overall  manual  quality.  It  was  also  found 
that  in  some  instances  only  those  portions  of  manuals  necessary  for  use 
in  performing  corrective  maintenance  were  evaluated. 

DEVELOPMENT  OF  IMAGES 

Based  on  the  results  of  the  preliminary  investigation,  TECOM 
immediately  initiated  a methodology  improvement  study  with  the  overall 
objective  of  developing  a systematic  and  quantitative  method  for  eval- 
uating technical  manuals. 

The  methodology  study  was  conducted  during  the  period  Septem- 
ber 1976  through  September  1977.  The  objective  of  the  study  was  to 
develop  a systematic,  quantitative  method  for  evaluating  equipment  man- 
uals which  would:  (1)  be  useable  by  Army  maintenance  evaluators,  (2) 
provide  for  a complete  evaluation  of  manuals,  (3)  be  compatible  with 
the  present  system  for  reporting  and  correcting  deficiencies,  (4) 
classify  and  quantify  manual  defects,  and  (5)  provide  a consistent 
measurement  standard  for  determining  overall  manual  quality. 

IMAGES,  as  developed  by  TECOM,  is  based  on  the  technical 
specifications  to  which  Army  equipment  manuals  are  prepared.  It  con- 
tains a strategy  and  checklists  for  evaluating  the  adequacy  of  the 
style,  technical  contents,  and  readability  of  manuals.  It  also  con- 
tains criteria  for  determining  the  comprehension  level  to  which  a 
manual  is  written  and  provides  a quantitative  measurement  system  for 
determining  overall  manual  quality. 

IMAGES  consists  of  11  parts.  A summary  of  the  Parts  of 
IMAGES  by  Category  of  Equipment  is  shown  in  Figure  1.  Part  J.  contains 
the  instructions.  This  part  is  applicable  to  all  categories  of  Army 
equipment  and  to  all  types  of  equipment  manuals.  Operator  -10  through 
General  Support  -40.  The  General  Style  and  Format  Requirements  are 
also  applicable  to  all  other  parts. 
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Category  of  Equipment* 

Governing 

Specification 

Ref 

Code 

Part 

Reference 

Introduction  to  IMAGES  (Appli- 
cable to  all  Categories) 

Part  I 

General  Style  and  Format 
Requirements 

MIL-M-38784A 

A 

All  Parts 

Mechanical  and  Construction 
Equipment,  Automotive  Equip- 
ment and  Power  Tools 
(Excludes  Combat  Vehicles) 

MIL-M-63009C 

B 

Part  II 

Telecommunications  Equipment 
(Except  Teletypewriters) 

MH-M-63019 

C 

Part  III 

Radar  Equipment 

MIL-M-63020 

D 

Part  IV 

Teletypewriter  Equipment 

MIL-M-63021 

E 

Part  V 

Electronic  Test  Equipment 

MH-M-63025 

F 

Part  VI 

Army  Aircraft  Equipment 

MIL-M-63026A 

G 

Part  VII 

Weapons,  Combat  Vehicles  and 

Fire  Control  Materiel 

MIL-M-63032A 

H 

Part  VIII 

Lubrication  Orders 

MIL-M-63004B 

J 

Part  IX 

Equipment  Serviceability 

Criteria 

MH-M-63006B 

K 

Part  X 

Commercial  Equipment 

MTL-M-62S8C 

L 

Part  XI 

Figure  1.  Parts  of  IMAGES  by  Category  of  Equipment 

*IMAGES  is  currently  being  expanded  to  Include  Missile  System 
Equipment  and  Nonnuclear  Explosive  Ordnance  Disposal  manuals. 
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Parts  II  through  XI  are  related  to  specific  categories  of 
equipment  and  the  governing  specifications.  Each  of  these  parts  is 
complete  so  that  the  maintenance  evaluator  only  needs  to  use  one  part 
of  IMAGES  to  evaluate  all  manuals  for  a given  system. 

Each  part  of  IMAGES,  parts  II-XI,  contains  the  following 
four  sections: 


a.  Section  I contains  the  Introduction  which  covers  the 
purpose  and  scope  of  the  evaluation,  applicable  levels  of  maintenance, 
and  step-by-step  instructions  for  performing  the  evaluation. 

b.  Section  II  contains  a detailed  checklist  of  General 
Style  and  Format  Requirements.  In  addition,  it  contains  general  tech- 
nical requirements  for  engineering  drawings,  illustrations,  and  sche- 
matics. It  also  contains  requirements  and  criteria  for  hazard  warn- 
ings, security  classification  markings,  and  quality  assurance 
provisions,  Including  readability  standards. 

c.  Section  III  contains  a detailed  checklist  for  Specific 
Technical  Requirements  by  type  of  manual  and  covers  the  type  -10 
Operator's  manual  through  the  type  -40  General  Support  Maintenance 
manual.  This  section  also  includes  procedures  for  evaluating  lubrica- 
tion instructions,  preventive  maintenance  checks  and  services,  trouble- 
shooting provisions,  and  special  tools  and  equipment. 

d.  Section  IV  contains  the  required  Review/Evaluation  forms 
for  classifying  and  recording  defects  and  the  criteria  for  determining 
the  overall  quality  level  of  the  manual. 

IMAGES  EVALUATION  PROCEDURES 

The  general  procedures  which  the  maintenance  evaluator 
follows  in  using  IMAGES  are  as  follows: 

Step  1 - Determine  from  the  Draft  Equipment  Publication 
Package  the  governing  specification  to  which  the  manual  was  prepared 
and  determine  that  a Maintenance  Allocation  Chart  (MAC)  is  available. 

Step  2 - Based  on  the  governing  specifications,  determine 
the  part  of  IMAGES  applicable  for  use  in  the  manual  evaluation. 

Step  3 - Following  the  detailed  review/evaluation  procedures 
in  Section  I,  and  using  the  checksheets  provided,  conduct  a complete 
evaluation  of  the  manual. 
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Section  I,  Introduction  to  IMAGES,  contains  Instructions  for 
the  classification  of  defects  to  assist  the  evaluator  in  judging  the 
severity  of  a manual  defect.  IMAGES  provides  for  three  classes  of 
defects  as  follows:  (1)  critical,  (2)  major,  and  (3)  minor.  In 
addition,  there  are  three  levels  for  each  category  of  defect.  The 
definitions  and  criteria  for  classifying  defects  are  included  on  a 
Classification  of  Defects  card  as  shown  in  Figure  2.  The  defect  class 
and  level  are  assigned  code  numbers  for  ease  of  recording  and  evalua- 
tion purposes.  For  example,  critical  defects  are  indicated  by  the 
numbers  1,  2,  or  3 and  are  assigned  a defect  value  of  100;  major  de- 
fects are  numbered  101,  102,  or  103  and  are  assigned  a defect  value 
wf  10.0;  and  minor  defects  are  numbered  201,  202,  or  203  and  are 
assigned  a defect  value  of  0.2. 

Checksheets  are  provided  for  classifying  and  recording  de- 
fects and  for  determining  the  overall  Quality  Index  value  for  the 
manual.  Two  different  types  of  checksheets  are  used  for  each  manual 
evaluation.  The  first  of  these  is  the  Maintenance  Requirements  by 
Functional  Group  Review/Evaluation  Checksheet.  A sample  of  this 
checksheet  is  shown  in  Figure  3.  This  checksheet  is  used  in  conjunc- 
tion with  the  detailed  checklist  for  specific  technical  requirements 
(Section  III  of  IMAGES)  to  determine  the  technical  adequacy  and 
accuracy  of  the  manual. 

The  Review/Evaluation  of  Format  Requirements  Checksheet  is 
used  in  conjunction  with  the  General  Format  and  Style  checklist  (Sec- 
tion II  of  IMAGES)  to  evaluate  the  adequacy  of  the  manual  with  regard 
to  specified  style,  format,  illustrations,  hazard  warnings,  and  read- 
ability requirements.  A sample  of  the  Review/Evaluation  Checksheet 
is  shown  in  Figure  4.  Each  requirement  in  the  checklist  is  compared 
with  the  applicable  text  to  determine  if  the  text  material  complies 
with  the  requirements. 

The  final  step  in  the  manual  evaluation  procedure  is  comple- 
tion of  the  Review/Evaluation  Summary  Sheet,  Figure  5.  The  total  num- 
ber of  defects  in  each  category  is  transferred  from  the  two  check- 
sheets  described  above  to  the  Summary  Sheet.  The  total  number  of 
defects  is  then  multiplied  by  the  weighted  value  for  each  category  to 
determine  the  total  value  for  weighted  defects.  The  "n"  value  of 
weighted  defects  per  page  is  then  determined  by  dividing  the  number  of 
weighted  defects  by  the  number  of  manual  pages  evaluated.  The  overall 
Quality  Index  is  then  determined  by  entering  the  Table  of  Quality 
Values,  which  is  also  shown  in  Figure  5.  The  Quality  Index  Value  is 
used  to  determine  overall  manual  quality  which  may  also  be  expressed 
in  adjectival  terms:  excellent,  good,  fair,  or  unacceptable,  as  shown 
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CLASSIFICATION  OF  DEFECTS 

This  Classification  of  Defects  card  is  used  to  assist  the  evaluator  in  judging  the  severity  of  a manual 
defect.  If  a defect  exists  in  the  manual,  it  is  selected  and  rated  in  accordance  with  the  definition  indicated. 
The  defect  c(ass  code  number  selected  for  entry  on  Form  No.  I and  Form  No.  2 should  define  the  defect  as 
nearly  as  possible,  based  upon  the  severity  of  the  defect  should  it  remain  uncorrccted  in  the  manual. 


| DEFECT  CLASS 
CODE  NUMBER 

DEFINITION 

CRITICAL  DEFECT  Informalion  that  is  omitted,  incorrect, 
incomplete  or  confusing  in  a manual  which  could  result  in: 

1 

. . hazardous  or  unsafe  conditions  for  personnel  using,  main- 
taining  or  depending  on  the  equipment  described  by  the 
manual. 

2 

destruction  or  impaired  performance  of  a major  tactical 
end  item  (missile,  lank,  vehicle,  etc.) 

3 • 

access  to  classified  material  by  unauthorized  personnel. 

CRITICAL  defect  is  indicated  as  1,  2 or  3 and  is  assigned  a 
defect  value  of  100. 

MAJOR  DEFECT  Information  that  is  omitted,  incorrect, 

incomplete  or  confusing  in  a manual,  other  than  a critical 
defect,  which  could  result  in 

101 

immediate  or  ultimate  failure  of  the  equipment  or  compo- 
nent of  the  equipment  or  immediate  cessation  of 
operation. 

102 

reduced  usability  or  inefficient  performance  of  the 
equipment. 

103 

unnecessary  difficulty  or  significant  loss  of  time  to  the 
user  of  the  manual  in  performing  a particular  function. 

MAJOR  defect  is  indicated  as  101,  102  or  103  and  is  assigned  a 
defect  value  of  10.0. 

MINOR  DEFECT  Information  that  is  omitted,  incorrect, 

incomplete  or  confusing  in  a manual  other  than  a critical 
or  major  defect,  which 

201 

would  not  affect  the  performance  of  the  equipment 

202  

. . deviates  from  standards  having  little  bearing  on  the 
usability  of  the  manual  or  on  the  equipment  described. 

203  . 

does  not  materially  reduce  the  usability  of  the  manual  for 
its  intended  purpose. 

MINOR  defect  is  indicated  as  201, 202  or  203  and  is  assigned  a 
defect  value  of  0,2, 

Figure  2, 


Classification  of  Defects  Card. 


REVIEW/EVALUATION  OF  MAINTENANCE  REQUIREMENTS  AUTHORIZED  BY  MAC 
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Figure  3 


Manual  Maintenance  Requirement*  Checkeheet. 


REVIEW/E  VALUATION  OF  MANUAL  FORMAT  REQUIREMENTS 


PERKINS 


Figure  4,  Manual  Style  and  Format  Checksheet 
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REVIEW/EVALUATION  SUMMARY 

tm S-XM3<->t»-2yTn Lh  Jjomtndtfvrc  »( tni  Acm 

SPECIFICATION  MIL  M-61AM__  TEST  SITE  PK^J  NO  KXMt 

TYPE  TEST-PX;  3 REQUIREMENTS  VERIFIED  i *M NOT  VERIFIED  I <J  )j^ 


Enter  totals  of  all  deficiencies  from  Review  Evaluation  Forms  No  I and  2 and  compute  as  follows 


Enter  Total  Number  of  CRITICAL  < I 2.  or  3)  DEFECTS  - Q X |00  * 

Enter  Total  Number  of  MAJOR  HOI.  102.  or  103)  DEFECTS - 4/  X 10  » tjo 

Enter  Total  Numberof  MINOR  (301. 303.  or  :03)DEFECTS: _ JL  x - * . tf. 

Total  above  for  number  of  WEIGHTED  DEFECTS  - * 4(4 , Lf 

Enter  total  number  of  MANUAL  PAGES  EVALUATED  — — * /©£_ 


Divide  total  number  of  WEIGHTED  DEFECTS  by  _ 

number  of  manual  pages  evaluated  to  obtain  |o<^V*'V  “n"  value 

the  V value  or  WEIGHTED  DEFECTS  per  page 


Match  the  “n"  value  above  with  the  n value  in  Table  of  Quality  Values.  The  Qi  value  in  the  adjacent 
column  is  the  value  to  be  entered  here 

Quality  Index  * ££rn 


.2L 

Manual  Quality 

90  - 100 

Excellent 

80  - 89 

Good 

70  - 79 

Fair 

below  7Q 

Unacceptable 

FORM  NO  3 

Pog 8^23. 

Evaluator  Name  Date 


Figure  5.  Review  Evaluation  Sunnary  Sheet 
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at  the  bottom  of  the  Summary  Sheet.  The  Acceptable  Quality  Level  for 
manuals  Is  a Quality  Index  score  of  70  or  above.  Any  score  below  70 
Is  considered  unacceptable  and  the  manual  is  considered  deficient. 

The  responsible  developer  Is  Informed  of  all  manual  defects,  as  well 
as  the  overall  acceptability  of  the  manual.  Deficient  draft  manuals 
mm  t be  corrected  before  the  manuals  are  considered  acceptable  for 
final  publication. 

PILOT  STUDY  OF  IMAGES 

A 6-month  pilot  study  of  IMAGES  was  conducted  at  US  Army 
Aberdeen  Proving  Ground,  Maryland;  US  Army  Yuma  Proving  Ground,  Ari- 
zona; US  Army  Electronic  Proving  Ground,  Arizona;  and  US  Army  White 
Sands  Missile  Range,  New  Mexico,  during  the  period  October  1976 
through  March  1977.  The  primary  objective  of  this  study  was  to  deter- 
mine the  adequacy  and  usability  of  IMAGES  for  evaluating  equipment 
manuals . 


Prior  to  the  Initiation  of  the  study,  a training  course  in 
the  use  of  IMAGES  was  given  to  maintenance  evaluation  personnel  at 
each  of  the  participating  proving  grounds.  A total  of  24  maintenance 
personnel,  14  military  and  10  civilian,  participated  in  a 5-day  train- 
ing program. 

The  equipment  manuals  selected  for  evaluation  at  each  of  the 
proving  grounds  were  those  available  at  the  time  of  the  study.  There 
was  no  preselection  of  candidate  manuals. 

A total  of  20  different  equipment  manuals  was  evaluated  dur- 
ing the  study.  Of  the  20  manuals  evaluated,  7 were  rated  acceptable, 
with  scores  of  70  or  better,  while  13  were  rated  unacceptable  with 
scores  less  than  70.  A summary  of  the  results  of  the  IMAGES  evalua- 
tion of  the  20  manuals  in  terms  of  Quality  Index  score  and  overall 
quality  rating  is  shown  in  Tables  1 and  2.  The  data  in  Table  1 show 
the  results  of  the  evaluation  of  the  seven  manuals  rated  acceptable. 
The  results  for  the  13  manuals  rated  unacceptable  are  shown  in  Table 
2.  The  types  of  manuals  were  varied  and  representative  ranging  from 
the  type  -12  Operator /Organizational  through  the  type  -34  Direct/ 
General  Support  level.  Those  manuals  designated  "P"  also  included 
Repair  Parts  and  Special  Tool  Lists. 
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TABLE  1 

MANUALS  RATED  ACCEPTABLE 
(Total  of  20  Manuals  Rated) 


Manual 

Quality  Index 

Quality 

Manual  Title 

Score* 

Rating 

Airborne  Laser  Tracker 

-34 

98 

Excellent 

Tank,  Fabric  Collapsible,  50,000  gal 

-12 

97 

Excellent 

Tractor,  Universal  Engineer,  Crawler 

-34P 

96 

Excellent 

TD  1065,  High  Speed  Data  Buffer 

-12 

79 

Fair 

Laser  Rangefinder,  AN/GVS-5 

-34 

79 

Fair 

TD  1069,  Digital  Multiplexer 

-34 

76 

Fair 

Target  Designator,  Laser,  AN/PAQ-1 

'0 

70 

Fair 

*A  score  of  70  or  above  Is  acceptable. 


TABLE  2 

MANUALS  RATED  UNACCEPTABLE 
(Total  of  20  Manuals  Rated) 


Manual  Title 

Manual 

Type 

Quality  Index 
Score* 

Quality 

Rating 

Laser,  Rangefinder,  AN/GVS-5 

-20 

67 

Unacceptable 

Radio  Set,  AN/ARN  123 

-24 

66 

Unacceptable 

MICV,  XM723 

Sj- 

CO 

1 

•» 

o 

CM 

1 

40,  31 

Unacceptable 

Doppler  Navigation  Set 

-20 

55 

Unacceptable 

Tractor,  Universal  Engineer, 

-12P 

45 

Unacceptable 

! Crawler  ! 

105MM  Gun,  M48A5,  Turret 

-20/1,-20/2 

41,  28 

Unacceptable 

Howitzer,  Medium,  Towed: 

-20,  -34 

40,  29 

Unacceptable 

155MM,  XM198 

TD  1065,  High  Speed  Data 

-12 

38 

Unacceptable 

Buffer 

TD  1069,  Digital  Multiplexer 

-12 

29 

Unacceptable 

Pneumatic  Tool  & Compressor 

-14 

17 

Unacceptable 

250CFM 

*A  score  of  70  or  above  Is  acceptable. 


If 
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A summary  of  the  results  of  the  evaluation  of  the  same  20 
manuals  set  out  by  classification  and  category  of  defect  is  shown  in 
Table  3.  There  were  495  defects  of  format  and  style  and  239  defects 
of  specific  technical  requirements  for  a total  of  734  defects  in  the 
20  manuals,  or  an  average  of  36.7  defects  per  manual.  The  number  of 
critical  and  major  defects  was  fairly  evenly  distributed  between  for- 
mat and  style  and  technical  requirements.  However,  there  were  sub- 
stantially more  minor  defects  of  format  and  style,  as  expected  by  the 
nature  of  the  requirements. 


TABLE  3 

CLASSIFICATION  OF  MANUAL  DEFECTS 
(20  Draft  Equipment  Manuals) 


Manual  Defects 

- IMAGES 

Format 

& St-\ 

rle 

Specific  Rec 

imts 

Total  Defects 

Crit 

E31 

Min 

Total 

Crit 

Maj 

Min 

Crit 

| Min 

IE5B31 

Defects 

132 

345 

495 

14 

121 

104 

239 

32 

Avg  Per 
Manual 

1 

6.6 

17.3 

24.8 

■ 

1 

11.9 

1.6 

1 

« 


Critical  defects  were  primarily  related  to  system  safety 
considerations  such  a s the  omission  of  required  instruction  for 
grounding  of  electrical  systems,  hazard  warnings  omitted,  and  the 
entire  safety  precautions  paragraph  omitted  from  the  manual.  Examples 
of  major  defects  include  failure  to  list  tools  required  to  perform  a 
job,  troubleshooting  diagrams  which  differed  from  the  equipment,  and 
the  omission  of  electrical  schematics. 

Sixteen  of  the  20  manuals  evaluated  using  IMAGES  had  been 
previously  evaluated  using  the  then  current  method.  A comparison  of 
the  total  number  of  defects  found  in  these  16  manuals  using  IMAGES, 
with  those  previously  reported  on  DA  Form  2028  (Recommended  Changes 
to  Publications  and  Blank  Forms)  under  the  existing  system,  is  shown 
in  Table  4. 
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TABLE  4 


COMPARISON  OF  IMAGES  AND  CURRENT  METHOD 
(16  Draft  Equipment  Manuals) 


Number  of  Manual  Defects 

IMAGES 

Critical 

Major 

Minor 

Total 

Total 

Difference 

Number  of  Defects 

24 

229 

345 

598 

342 

(256) 

Average  Per  Manual 

1.5 

14.3 

21.6 

37.4 

21.4 

(16) 

In  terms  of  total  defects,  there  were  256  or  43Z  more  de- 
fects found  using  IMAGES  than  found  when  using  the  current  method. 

While  the  current  method  did  not  classify  the  defects,  analysis  of  the 
results  showed  about  the  same  distribution  of  critical,  major,  and 
minor  type  defects  using  both  methods. 

A summary  of  questionnaire  results  obtained  from  19  of  the 
20  evaluators  who  participated  in  the  pilot  study  Is  shown  In  Table  5. 
One  military  evaluator  was  transferred  prior  to  administration  of  the 
questionnaire.  The  responses  to  question  1 show  that  there  was  a rea- 
sonably balanced  distribution  between  less  experienced  and  highly  ex- 
perienced maintenance  personnel  who  participated  in  the  study.  The 
responses  to  questions  2 and  3 show  that  a substantial  majority  of  the 
evaluators  gave  IMAGES  a higher  rating  than  the  present  procedure. 

The  responses  to  question  4 show  that  a majority  of  the  evaluators  felt 
tt  - IMAGES  required  more  time  than  the  present  method.  This  response 
wa  xpected  since,  with  the  exception  of  EPG,  the  present  method  did 
not  include  a 100Z  evaluation  of  each  manual.  It  is  noted  that  at  EPG, 
where  the  present  method  Included  a 100Z  evaluation  of  most  manuals, 
all  4 evaluators  responded  that  IMAGES  required  less  time  than  the 
present  ' it hod. 
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TABLE  5 

IMAGES  QUESTIONNAIRE  RESPONSES 
(19  Maintenance  Evaluators) 


Questions 

Responses 

APG 

YPG 

EPG  WSMR 

Total 

1.  Previous  manual  eval- 

-1  yr 

2 

1 

2 

1 

6 

uatlon  experience? 

1-2  yrs 

1 

1 

1 

1 

4 

+2  yrs 

3 

2 

1 

3 

9 

2.  Rate  present  procedure 

Good 

1 

2 

4 

1 

8 

for  Insuring  adequacy 

Fair 

4 

2 

0 

4 

10 

and  accuracy  of  manuals? 

Poor 

1 

0 

0 

0 

1 

3.  Rate  IMAGES  for  lnsur- 

Good 

5 

3 

4 

5 

17 

ing  adequacy  and  accuracy 

Fair 

1 

1 

0 

0 

2 

of  manuals? 

Poor 

0 

0 

0 

0 

0 

4.  Time  required  for  IMAGES? 

Less 

0 

1 

4 

0 

5 

Same 

1 

1 

0 

0 

2 

More 

5 

2 

0 

5 

12 

IMAGES  Is  designed  to  be  used  In  conjunction  with  "hands- 
on"  performance  of  actual  or  simulated  maintenance  tasks  or  used 
strictly  for  a desk  audit  of  equipment  manuals.  The  "hands-on"  ex- 
perience Is  of  particular  value  In  the  evaluation  of  schematics. 
Illustrations,  and  troubleshooting  procedures.  Both  techniques  were 
used  successfully  during  the  pilot  study. 

SUMMARY 


The  results  of  the  pilot  study  and  subsequent  use  by  TECOM 
In  evaluating  manuals  for  a variety  of  Army  systems  currently  under 
development  have  demonstrated  the  value  and  utility  of  IMAGES.  IMAGES 
has  been  adopted  by  TECOM  as  a standard  Test  Operating  Procedure  and 
Its  use  should  result  In  a substantial  Improvement  In  the  accuracy, 
readability,  and  understandability  of  Army  equipment  manuals  to  be 
sent  to  the  field  in  the  future. 

IMAGES  Is  currently  being  expanded  for  use  in  evaluating 
the  Army's  "new  look"  manuals  prepared  in  accordance  with  Integrated 
Technical  Documentation  and  Training  (ITDT)  specifications. 
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